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Consider TV points randomly distributed along a line segment of unitary length. A walker explores 
this disordered medium moving according to a partially self-avoiding deterministic walk. The walker, 
with memory ^, leaves from the leftmost point and moves, at each discrete time step, to the nearest 
point which has not been visited in the preceding ^ steps. Using open boundary conditions, we 
have calculated analytically the probability Pn{^) = (1 — 2~^)^~^~^ that all A'^ points are visited, 
with A 3> ^1 2> 1. This approximated expression for PN^^i) is reasonable even for small A^ and 
H values, as validated by Monte Carlo simulations. We show the existence of a critical memory 
/xi = In A/ In 2. For < ^1 — e/(2 In 2), the walker gets trapped in cycles and does not fully explore 
the system. For ^ > /ii + e/(2 In 2) the walker explores the whole system. Since the intermediate 
region increases as In A and its width is constant, a sharp transition is obtained for one-dimensional 
large systems. This means that the walker needs not to have full memory of its trajectory to explore 
the whole system. Instead, it suffices to have memory of order logj A'. 



I. INTRODUCTION 

While random walks in regular or disordered media 
have been thouroughly explored pj, deterministic walks 
in regular and disordered media [1, 0, |^, @ have been 
much less studied. Here we are concerned with the prop- 
erties of deterministic walks in random media. 

Given N points distributed in a d-dimensional space, a 
possible question to ask is how efficiently these points can 
be visited by a walker who follows a simple movimenta- 
tion rule. The search for the shortest closed path passing 
once in each point is the well known travelling salesman 
problem (TSP), which has been extensively studied. In 
particular, if the points coordinates are distributed fol- 
lowing a uniform deviate, results concerning the statis- 
tics of the shortest paths have been obtained analyti- 
cally 0, H, Q • To tackle the TSP, one imperatively needs 
to know the coordinates of all the points in advance. 
Global system information must be at the walker's dis- 
posal. 

Nevertheless, other situations may be envisaged. For 
instance, suppose that only local information about the 



•Electronic address: 'cesartercariol@gmail. co"iii] 
^Electronic address: caminlios'rsg@yalioo. com.br| 
■f Electronic address: jasmartinez@ffclrp.usp.br| 



neighborhood ranking of the current point is at the 
walker's disposal. In this case, one can think of sev- 
eral deterministic and stochastic strategies to maximize 
the number of visited points while trying to minimize the 
travelled distance. 

Our aim is to study the way a walker explores the 
medium following the deterministic rule of going to the 
nearest point, which has not been visited in the previous 
/i discrete time steps. We call this partially self- avoiding 
walk of the deterministic tourist walk. Each trajectory, 
produced by this deterministic rule, has an initial tran- 
sient of length t and ends in a cycle of period p. Both 
transient time and cycle period can be combined in the 
joint distribution s'"^J(t,p). The deterministic tourist 
walk with memory /x = is trivial. Every starting point 
is its own nearest neighbor, so the trajectory contains 
only one point. The transient and period joint distri- 
bution is simply S^^^Jlt^p) = 6t,oSp,i, where 6ij is the 
Kronecker delta. With memory /i = 1, the walker must 
leave the current point at each time step. The transient 
and period joint distribution has been obtained analyti- 
cally for 1 [10]. This memoryless rule (/i = 1) does 
not lead to exploration of the random medium since after 
a very short transient, the tourist gets trapped in pairs of 
points that are mutually nearest neighbors. Interesting 
phenomena occur when greater memory values are con- 
sidered. In this case, the cycle distribution is no longer 
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peaked at Pmin = A* + 1 , but presents a whole spectrum 
of cycles with period p > Pmin , with possible power-law 
decay [HI, [H, [l^]- These cycles have been used as a 
clusterization method and in image texture analy- 
sis [Hp]. 

It is interesting to point out that, for ID systems, de- 
terminism imposes serious restrictions. For any fj, value, 
cycles of period 2^ + l<p<2^ + 3 are forbidden. Ad- 
ditionally, for /i = 2 all odd periods but Pmin = 3 are 
forbidden. Also, the heavy tail of the period marginal 
distribution S'^J^^ip) = J2t i^^P) ^^^'^ oftcn- 
visited-large-period cycles This allows system ex- 

ploration even for small memory values {fi <^ N). 

The article presentation is divided as follows. In 
Sec. nil we consider a walker moving according to the de- 
terministic tourist rule in semi-infinite disordered media. 
Firstly, we calculate exactly the distribution of visited 
points, which allowed us to jusfify a very good approxi- 
mation using a simple mean field argument. Secondly, we 
propose an alternative exact derivation for this distribu- 
tion using the exploration and return probabilities, which 
allows application in the tourist walk in finite disordered 
media. This is done in Sec. IIIIl where we obtain the per- 
colation probability and show the existence of a crossover 
in the walker's exploratory behavior at a critical mem- 
ory fii ~ InN/ In 2 in a narrow memory range of width 
e ~ e/ln2. This crossover splits the walker's behavior 
in essentially two regimes. For /i < — e/2, the walker 
gets trapped in cycles and for fj, > ni + e/2, the walker 
visits all the points. The calculated quantities have been 
validated by Monte Carlo simulations. The fact that to 
explore the whole disordered medium the walker need to 
have only a small memory (of order log2 N) and other 
final remarks are presented in Sec. IIVI 



II. SEMI-INFINITE DISORDERED MEDIA 

A random static semi-infinite medium is constructed 
by uncountable points that are randomly and uniformly 
distributed along a semi-infinite line segment with a 
mean density r. The upper line segment of Fig. [T] rep- 
resents this medium, where the distances Xk between 
consecutive points are independent and identically dis- 
tributed (iid) variables with exponential probability den- 
sity function (pdf): g{x) = re~^^ , for x > and (/(x) = 0, 
otherwise. In the following we analytically obtain the 
statistics related to deterministic tourist walk performed 
on semi-infinite random media. 



A. Distribution of the number of visited points 



Here we obtain analytically the probability 5'^°^] (n) for 
a walker, with memory /i and moving according to the 
deterministic tourist rule, to visit n points of semi-infinite 
media. The exact result is obtained and this allowed us 
to justify a simple mean field approach. 



^ Zl Z2 24 25 2g 27 ^ 

FIG. 1: Scheme showing the equivalence between a finite and 
a semi-infinite disordered media. Along the upper line seg- 
ment the points are generated using the random distances Xk 
with exponential pdf. In the lower line segment, the number 
of points (N) is fixed and normalized to its total length, where 
Zk are the normalized coordinates. 



1. Exact Result 

Consider a walker who leaves from the leftmost point 
s 1 , placed at the origin of the upper line segment of Fig . [1] 
The conditions for the walker to visit n > jj, + 1 distinct 
points are: 

1. the distances xi, X2, . . . , may assume any value 
in the interval [0; 00), since the memory fi prohibits 
the walker to move backwards in the first /i steps, 
so that the first /i + 1 points are indeed visited, 

2. each of the following distances x^+i, a;^+2, 
Xn-i must be smaller than the sum of the ji pre- 
ceding step distances, until the tourist reaches the 
point s„, and 

3. the distance Xn must be greater than the sum of 
the /i preceding ones, to enforce the walker to move 
back to the point s„_^, instead of exploring a new 
point Sn+i- 

Once the walker has returned to the point Sn-fi, he/she 
may revisit the starting point si , get trapped in a attrator 
or even revisit the point s„, but he/she will not be able 
to transpose the distance barrier Xn between the points 
Sn and Sn+i- Actually, no new points will be visited any 
longer. Combining these conditions, the probability for 
the walker to visit n distinct points is 



M />OG 

^S(-) = n / d. 



Xj re ""^^ 



n-l 



n 



dxj 



(1) 



The difficulty to obtain S'^^J^{n) is that the n intregrals 
are chained and the integration procedure must start 
from the rightmost factor. Applying the substitutions 
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Vj — ^ J with 1 < j < n, one has: 

n 



(2) 



where the form of each functional Xj depends on j: 
Jo dyj , for 1 < j < ^ 
fldy,, for < J <n-l (3) 



I Jo'' ^y. 



for j 



and each integration Hmit ijj = Yit^j-ii links Tj to 
the preceding fi integrals. This means that Eq. [2] must 
be evaluated from X„ to Xi . Notice that r has been elim- 
inated, indicating that the number of visited points does 
not depend on the medium density. 

We call attention that the novelty of this calculation 
concerns dealing with the powers of yj. Fig. [5] illustrates 
the calculation of Eq.[2]for the particular case n — 3 and 
n = 7. In this scheme, the relevant quantities are the yj 
powers in the integrand, since all y's disappear after all 
integration levels are performed. The integration process 
consists basicly of three steps, where each one of them 
represents a case of Eq. |3l 

1. the first integral X7 (third case of Eq. [3]) is trivially 
evaluated to its upper limit j/y, yielding the root 



node ylvly^, with all the integrand variables raised 
to the first power. These powers are denoted as ai, 
02, . . . , flp, where, in particular, is the power of 
integrand of the current level. 

2. each bifurcation level represents an integral from 
Xq to X4 (second case of Eq. [3]). 

(a) a unit is added to the power and it be- 
comes a new factor a,^ -I- 1 at the denominator 
of the following level [this is just J y"^ dy — 
2/'^+V(a + l)]. 

(b) for each bifurcation, in the upper fractions, 
the remaindering variables keep their powers 
and the new y raised to 0. 

(c) in the lower fraction, we sum -I- 1 to each 
power of y's and fraction sign is switched. 

3. the last level represents the integrals from X^ to 
Xi (first case of Eq. [3]), where a unit is added to all 
powers ai, a2, ■ ■ ■ , cifj, and they become new factors 
at the denominator. 

Generalizing the reasoning of the scheme of Fig. [5] for 
arbitrary /i and n, Eq. [2] may be writen as the following 
recursive formula 



n = ^ + 1, + 2, . 



,(4) 



with 



/^[j-l, shift(a)]-/^b-l, shift(a) + (a^+l)-l] 



1/nLiK 



1), 



if j > M + 1 
if J = M + 1 



(5) 



where 1 — (1, 1, 1, . . . , 1) and a = (ai, 02, as, ... , a^,) are 
/Li-dimensional vectors, shift(a) = (0, ai, a2, . . . , a^^i) is 
the acidic coordinates shifting and j is the integration 
level, also used as stop condition. Observe that the initial 
condition 1 of Eq. 0] and the upper and lower cases of 
Eq. [5] represent the third, second and first cases of Eq. O 
respectively. 

Observe that p„im = /i + 1 is the minimum allowed 
cycle period in the deterministic tourist walk [lT| and, 
once the memory fi assures the walker visits at least /x -|- 1 
points, the number of extra visited points Ue = n — Pmin 
is the relevant quantity since all the distributions 5^°^] 
start at the same point = 0, regardless the fi value. 

Although the recursive relation of Eq. [5] is exact, it is 
not efficient for algebrical treatment. Even for numerical 
calculation it presents several disadvantages. It is diffi- 
cult to implement due to its recursive structure and the 
processing time grows exponentially. Such exponential 
time-dependence limited the plots of Fig. [3] and Fig. 2] to 



rie < 30. The continous lines of Fig. [3] represent Eq. [3] 
for different values of fi. As one can see from this figure, 
a remarkable property is 

^dK = o) = ^, (6) 

for all fi. This is exactly the probability to have a null 
transient and a cycle with minimum period Pmin in the 
one-dimensional tourist walk. 



2. Mean field approximation 

The recursivity of Eq. [5] has been inherited from the 
chained integrals of Eq. [2l However, for /j, ^ 1 a mean 
field approximation may be used to untie those integrals. 
It consists of replacing the products ijj by their mean 
values. 
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FIG. 2: Calculation scheme for the chained integrals of Eq. [2] 
Here we have considered the example of /i = 3 and n = 7. We 
focus on the dynamics of the powers of y's along the bifurca- 
tion path, which leads to the recursive relation (Eq. [SJ . 



variables yj = e"'"^^ (applyed to Eq. [T]) are iid according 
to a uniform deviate in the interval (0, 1]. The first con- 
dition (0 < < ^) of Eq. [3] states that the variables yi, 
2/2, • ■ • J Uii may freely vary from to 1. Once for /i ^ 1 
the product y^^+i — 11^=1 has a small variance, it can 
be approximated by its mean value {y^+i) — 2~'^. 

Concerning the next product = nfci2 j the 

variables j/2, ys, ■ ■ ■ , y^j-i-i are not all iid, because y^+i has 
just been constrained to the interval [2~^,1]. However, 
for /i 1, the interval [2~'^, 1] becomes close to [0, 1], al- 
lowing 2/^^+2 to be also approximated by the mean value 
2"'^. This reasoning can be indutively applied for the 
remaining integration limits jjj. Thus, Eq. [3]is approxi- 
mated to 



lo d% ' for < j < 

dj/j , for /i + 1 < j < n - 1 
lo dj/j , for j 



(7) 




FIG. 3: Distribution of for fi varying from 1 to 9. Contin- 
uous lines refer to exact form of Eq. |4] and dotted lines refer 
to approximated form of Eq. [8] 



Observe that these integrals are no longer chained and 
that S'^^l (n) is still given by Eq. O which leads to 

2-^(1 -2"'T-^"\ (8) 

with n = + 1, /i + 2, . . . , 00 and yields E(n) = 2^ + /x, 
which may be interpreted as the characteristic range of 
the walk, and Var(n) = 2^^ - 2^. Dotted lines in Fig. [3] 
represent this approximation for 1 < /i < 9. 



B. Exploration and return probabilities 

The purpose of the calculation of the exploration and 
return probabilities is twofold. It is an alternative argu- 
mentation to obtain Eq. [5]and these probabilities lead to 
simple arguments to obtain the percolation probability 
for a finite disordered. 



To fully appreaciate this mean field argumentation 
consider first the distribution of a product of uniform 
deviates. Let yi, 7/2, ■ • • , y^i be independent random 
variables uniformly distributed on the interval (0, 1]. To 
obtain the pdf p{y) of the product y = nfc=iJ/fci ^^t 
us apply the transformation w = — hiy = '^k=i^k, 
where Wk = — In yk with 1 < k < fi are iid variables 
with exponential pdf of unitary mean. Thus, the sum 
w follows a gamma pdf p(?Z') = w^~^e~^ /T(ijl). Since 
|p(y)dy| = \p{w)dw\ one obtains the distribution of y: 
Piy) ^ 111 J')^^^/r(/i), whose the mth moment is 
(y™) = (m + l)-''. 

The above tools can be used due to the fact that all the 



1. Upper tail cumulative probability: an exact calculation 

A similar argumentation used to obtain Eq. |4] may be 
used to obtain the upper tail cummulative distribution 

F^^tin) = E^„'5'^^](fc). This distribution gives the 
probability for the walker to visit at least n points. The 
only modification is that, once the walker has reached the 
point Sn, he/she can either move backwards or forwards. 
Therefore, the rightmost integral of Eq. [T] is no longer 
necessary, so 

n-l 
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where each functional Xj is given by Eq. [S] The root node 
of Fig. [2] is now set to 1 (or, equivalently, yly^y^), which 
leads to 



-(-) 



1,0] 



n = ^+1,^ + 2,. 



(10) 



where = (0, 0, . . . , 0) is the /i-dimensional null vector 

and is given by Eq. [51 Observe that (n) uses the 
same recursive structure of Eq. [51 but with a different 
initial condition (0 instead of 1). If the approximation 
of Eq. [71 is used as approximation to evaluate Eq. [9l one 
readily has 



(1-2"'^) 



fl\7l — ^— 1 



(11) 



The memory fi assures the walker, leaving from the 
point si, to move forward in the first /i steps. In con- 
strast, the following steps are uncertain, since the walker 
may either move forwards and visit a new point or return 
and stop the medium exploration. In analogy to the geo- 
metric distribution, it is useful to define the exploration 
probability (/^(j) (taken as failure) as the probability for 
the walker to visit a new point at the jth uncertain step. 

Therefore, the return probability Pf_i(j) (taken as suc- 
cess) for the jth uncertain step is equal the probability for 
the walker to visit exactly n = n + j points conditionated 
to the fact that he / she has already visited n = /i + j — 1 
points. This probability is given by 



(12) 



where is given by Eq. [31 

Fig. [H shows the behavior of p^{j) for the first 30 un- 
certain steps, with /i varying from 1 to 9. One can ob- 
serve that for /i ^ 1 the return probability Pfj,{j) along 
the walk is almost constant and equal its initial value 
Pp(l) ~ 2^^. In this way, one can verify empirically 
that for fi 1 the return probabilities can be taken as 
— 2^^ for all steps, as well as = 1 — 2^^ can be 
taken for all exploration probabilities. 

This empirical approximation for the return probabil- 
ity can justified analytically using Eqs. [51 and [Tl] in its 
definition: 



-^(oo)/ I 2^ 



(13) 



For p — 1, Ue is numerically equal to the transient 
time t (what does not mean that they are the same part 
of the trajectory, the transient is the beginning of it and 
He counts the final points), and in this case Eqs. [H [TOl 



and [T^ assume the simple exact closed forms S^l 

(n, + l)/in, + 2)!, F^^K) = l/("e + 1)! and pi(j; 
j/(j -f 1), which have been previously found in Ref. 
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FIG. 4: Return probability given by Eq. 1121 with p. varying 
from 1 to 9. 



2. An alternative derivation 



These approximated expressions for exploration and 
return probabilities can also be obtained by analytical 
means through a more direct derivation. Consider again 
the tourist dynamics with a walker who leaves from the 
point si, placed at the origin of the semi-infinte medium. 

The first fi + I points are indeed visited, because the 
memory fi prohibits the walker to return. Thus, the dis- 
tances xi, X2, ■ ■ ■ , may assume any value in the in- 
terval [0, oo). 

The exploration probability 9^(1) for the first uncer- 
tain step can be obtained imposing that the distance 
x^^i must be smaller than the sum xi = 
Since the variables xi, X2^ a;^ are iid with ex- 

ponential pdf, xi has a gamma pdf. Hence q^{l) = 



e--^^ /T{fi)] C da;^+ire-"-+i 



1 



The exploration probability q^(2) for the second uncer- 
tain step is not exactly equal to (7/^(1). Once the distance 
x^+i must vary in the interval [0,a;i], the variables X2, 
X3, . . . , a;^+i are not all independent, and consequently 
X2 = '^k=2 has not exactly a gamma pdf. However, 
iov p^ 1, x^+i rarely exceeds xi [this probability is just 
P(a;^+i > xi) — 1 — q^{l) = 2~^, meaning that a weak 
correlation is present for ^ 1]. Therefore, one can 
make an approximation assuming that X2 still follows a 
gamma pdf and considering q^{2) « 9/^(1)- The same 
argumentation can be used for the succeeding steps. 

When the point s„ is reached, the walker must turn 
back, stopping the medium exploration. Once 9^(1) is 
taken for all g^, the return probability is = 1 — = 

2-^ and one has: S'^°^.-(rie) = 2-'^(l - 2"'^)"=, which is 
the result of Eq. [i 
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III. PERCOLATION PROBABILITY FOR 
FINITE DISORDERED MEDIA 

The finite disordered medium is constructed by N 
points whose coordinates Zk are randomly generated in 
the interval [0, 1] following a uniform deviate as depicted 
in Fig. m 

Numerical simulation results pointed out that the 
exploration and return probabilities obtained for the 
semi-infinite medium may also be applied to this finite 
medium. This is not trivial, since all results for the semi- 
infinite medium have been obtained assuming that the 
distances between consecutive points are iid variables 
with exponential distribution. Obviously the distances 
between consecutive points in the finite medium are not 
iid variables, nor have exponential distribution. 

Nevertheless, the equivalence between these two media 
can be argued as follows. The abscissas of the ranked 
points in the finite medium follow a beta pdf If 
one restricts the semi-infinite medium length to the first 

-|- 1 distances and normalizes it to fit in the interval 
[0,1], then the abscissa of its fcth ranked point is z^. — 
Uk/{Uk + Vfe), where Uk ^ xi + X2 + ■ ■ ■ + Xk and Vk = 
Xk+i + Xk+2 + • • • + xjsi^i. Fig. [1] shows an example for 
N — 7 normalization. 

This normalization does not affect the tourist walk, 
because in this walk only the neighborhood ranking is 
relevant, not the distances themselves [Hl^^. Since Uk 
and Vk have gamma pdf, Zk has beta pdf [l7[, as in the 
genuine finite medium. 

The probability Pn (/i) for the exploration of the whole 
TV-point medium can be derived noticing that the walker 
must move forward N — (fi+l) uncertain steps and, when 
the last point sat is reached, there is no need to impose 
a return step. Therefore the percolation probability is 

^^(M)=9r(^+^^-(i-2-^)^-^-^ . (14) 

It is interesting to point out that the percolation proba- 
bility relates directly to the upper tail cummulative func- 
tion as seen by Eq. [TlJ The diference between them is 
only on in the interpretation of the number of visited 
points N, but this can be justified because of the nor- 
malization to the finite medium discussed above. 

Fig. [5] shows a comparison of the evaluation of Eq. [HI 
and the results of Monte Carlo simulations. From this 
figure one clearly sees that the probability of full explo- 
ration increases abruptly from almost to almost 1. 

From the analogy with a first order phase transi- 
tion, we define the crossover point as the maximum 
of the derivative of PAr(/i), with respect fi. This im- 
plies that the second derivative vanishes at the maxi- 
mum d„PAr(/i)| (c) = 0, leading to a transcental equa- 

(c) 

tion which cannot be solved it analytically to obtain . 

An estimation value of [i\ can be calculated consider- 
ing N ^ ^ ::§> 1 and Eq. [T3] may be approximated to 
P/v(/i) = (1 — 2^^)^, and at infiexion point, one has 

/xi = log2^. (15) 



A simple interpretation can be given to /ii. It is just the 
number of necessary bits to represent the system size N. 
To evaluate the width of the crossover region, use the 
slope of P/v(/i) at /ii, which results to ln2/e, for all N 
[sec Fig. [5] . The crossover region has a constant width 



In one hand, as N increases, the critical memory slowly 
increases (as log2 N) but its deviation is independent of 
the system size, so that a sharp crossover is found in the 
thermodynamic limit {N 3> 1). We stress that the ap- 
proximations employed lead to satisfactory results even 
for small N and fi values. 




FIG. 5: Percolation probability for some fixed A'^ values. 
Empty circles are given by Eq. [14] and full ones represent 
numerical simulations (M = 100 000 maps for each and fi 
values), error bars are smaller than symbol size. Continuous 
lines are plotted only to guide eyes. Analytical results are 
satisfactory, when compared to numerical simulation, even 
for small A'^ and /i values. The crossover points fii are given 
by Eq. 1151 which are weakly dependent on but all of them 
have the same constant dispersion e ~ 4 (Eq. I16|l . 



On the other hand, if one use the reduced memory 
p. — (/i — /J,i)//ii, the crossover occurs in p,i = 0, but now 
the crossover width depends on the size of the system as 

l/l0g2iV. 



IV. CONCLUSION 

Our main result is that to explore the whole medium 
the walker does not need to have memory of order N , a 
small memory (of order In TV) allows this full exploration. 

All the exact results calculated here are in accordance 
to the limiting case /i = 1 obtained in Ref. Also, 
they can be applied to an infinite line segment, where 
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random points are distributed in both sides of the start- 
ing point. 

An interesting result we have obtained in the one- 
dimensional deterministic tourist walk is that the prob- 
ability to have a null transient and a minimum cycle is 
2^^, where /i < /ii is the memory of the walker. 

The distance constraints can be generalized to a d- 
dimensional Euclidean space and possibly this calculation 
scheme can be employed in such interesting situation. 

Finally, the tourist rule can be relaxed to a stochas- 
tic walk. In this case, the walker goes to nearer cities 
with greater probabilities, given by an one-parameter (in- 
verse of the temperature) exponential distribution. This 
situation has been studied for the non-memory cases 
(/i = [III and At = 1 [l^) and we have detected the ex- 



istence of a critical temperature separating the localized 
from the extended regimes. It would be interesting to 
combine both in the tourist walks, stochastic movimen- 
tation (driven by a temperature parameter) and memory 
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